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ABSTRACT 

Under the administrator evaluation program adopted at 
Vincennes University, all faculty and professional staff are invited 
to evaluate each administrator above them in the chain of command. 
Originally based on the Purdue University "cafeteria" system, this 
evaluation model has been used biannually for 10 years. In an effort 
to simplify the system, a single evaluation form was developed. This 
form includes: (1) a rank-ordered set of 22 statements covering the 
basic requirements of managerial responsibility; (2) a five-point 
Likert scale response legend; (3) a check-off to indicate the level 
of each person responding; and (4) a code for every administrator on 
campus. The cover letter accompanying the survey explains that up to 
six administrators can be evaluated per page, and th'»t participation 
is voluntary and confidential. A flat file of responses is built and 
analyzed with the statistical analysis system. The cross-tabulations 
for each question by each level of respondents are entered onto a 
spreadsheet, and an evaluative index is developed, yielding an 
overall positive or negative response value. Group norms are 
developed based on all responses regarding deans, department heads, 
and vice presidents. Although most responses to the revised form were 
positive, overall evaluation response was lighter than desired and 
lower than previous years. The evaluation will be repeated in 1996. 
The paper includes 13 references, copies of the cover letter, 
evaluation form, and norms for academic department heads. (KP) 
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A Model for Administrative Evaluation by Subordinates 



Abstract: Colleges and universities routinely evaluate students, faculty, and support 
staff. But a system for evaluating administrators is less well defined. This paper 
describes a microcomputer-analyzed model of administrative evaluation whereby all 
professional faculty and staff are invited to voluntarily evaluate all administrators above 
them in their chain of command, right up to the president of the college. 

Fair and creative ways to measure effectiveness of those who administer higher 
education is a universal but elusive goal. Barnard (1938), Katz (1955), Likert (1958), 
Drucker (1964), and many others helped define what is expected of "good" managers 
and suggested how to evaluate effectiveness. Fisher (1978) applied the principles of 
administrative evaluation to higher education. Trow (1982) published a "Practical 
Manual" and the Educational Research Services (1985) a comprehensive "Report." 
Administrator evaluation was a 'hot topic' for Phi Delta Kappa in 1985. (Barber). 

Purdue University published a "cafeteria approach" to instructional evaluation in 
1974. This approach was adapted for evaluation of administrators by subordinates at 
West Virginia University (Goodwin and Smith, 1981). Budig reported on one 
application (1986). Miller (1993) describes administrative evaluation in a shared " 
governance environment, which includes an element of evaluation by subordinates. 

Description of this study 



Vincennes University has adopted a system whereby all faculty and professional 
staff are invited to evaluate, on a voluntary and confidential basis, each administrator 
above them in their chain of command, right on up to and including the president. 



Originally based on the Purdue University cafeteria system, this evaluation model has 
been used biannually for ten years. The system was revised and simplified in spring 
1994. 

A task force was appointed by the President and composed of faculty, 
administrators, and professional staff. The task force given the responsibility of 
simplifying the system, and designing a single evaluation form which could be used by 
all administrators, with no constraints as to length, method of administration, etc. The 
result was a rank-ordered a set of twenty-two statements which they felt covered the 
basic requirements of any person with managerial responsibility in this institution. 

A single form was developed (Attachment 1) which listed the 22 statements, a 
response legend, a checkoff to indicate the level of each person responding, and a 
coding for every administrator on campus. The cover letter explained that up to six 
administrators could be evaluated on this page; that additional written comments may 
be submitted; and that participation was voluntary and confidential. 

A flat file of responses was built and analyzed with SAS. The cross-tabulation for 
each question by each level of respondents was manually entered onto a spreadsheet, 
and an evaluative index developed which would yield an overall positive or negative 
response value (Attachment 2). The indices were then dropped into a bar graph to 
(^ttachment 3). 

Group norms were developed, based on ail responses regarding deans, 
department heads, vice presidents. A cover letter of explanation included data 
limitations and suggested comparisons to norms. 
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A flat file of responses was built and analyzed with SAS. The cross- 
tabulation for each question by each level of respondents was manually entered 
onto a spreadsheet, and an evaluative index developed which would yield an 
overall positive or negative response value (Attachment 2). The indices were then 
dropped into a bar graph to (Attachment 3). 

Group norms were developed, based on all responses regarding deans, 
department heads, vice presidents. A cover letter of explanation included data 
limitations and suggested comparisons to norms. 

Response was lighter than desired, and lower than under the previous 
system. Most of the evaluations were very positive. The system will be repeated 
in 1 996, at which time it is hoped that the system can be automated a bit more. 
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Attechment One 



TO: 



University Faculty and Professional Staff 



FROM: 



Phillip M. Summers 



SUBJECT: 1994 Administrative Evaluation 
DATE:* March?, 1994 

For ten years Vincennes University has had a unique form of voluntary administrative 
evaluation. Every two years all faculty and professional staff have had the opportunity to 
evaluate each of the administrators above them in their reporting line. The process was very 
cumbersome and labor-intensive. In January I appointed a task force, chaired by Robert Slayton. 
to review the process and recommend simplification. The attached one-page evaluation is the 
result of their work. 

The 1994 administrative evaluation consists of twenty-two questions v/hich mil be used for ail 
administrative positions. You may voluntarily choose to evaluate everyone above you in your 
reporting line, including the Vice President of your service area and the President. All of your 
evaluations will be on a single page. 

1. Please indicate (see check box) whether you are a faculty/professional staff person, a 
department head, or a vice president, dean, or administrator. 

2. You may evaluate up to six persons above you in your reporting line. Please enter the 
two-digit code for each administrator above you in your reporting line above the columns. Code 
for alll994 administrators are found on the back of the evaluation form. 

3. Enter your evaluation "scores" for each of the 22 questions in a column under that person's 
code according to the following scale: 



5 
4 
3 



0 



"I Strongly Agree" 

"I Agree" 

"I am Undecided" 

"I Disagree 

"I Strongly Disagree' 

"I don't know" 
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T994 Administrative Evaluation . Continued 



4. If you wish to add comments, a separate page has been provided. Be sure to indicate the 
name or code number of the person toward whom the comments are directed. Please xerox . 
additional pages if you wish to make comments concerning more than one administrator in your 
line. The administrator being evaluated will receive the re-typed written comments. 

5. Please return or mail the evaluation form to the President's Office, no later than April IsL 

Return of this evaluation is entirely voluntary. The evaluation process has been designed to 
provide as much anonymity as possible. This evaluation is important for the professional 
development of the University's administrators. 

If you have any questions concerning the evaluation forms or process please call Dr. Budig at 
Ex. 4377 or my office. Thank you for joining the process to provide evaluation information for 
the Vinccnncs University administrators. 

PMS/jeb 
Enclosure 
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Attachment One 



BY: (pteaM check): 

Vice President. Dean, or 

Administrator 
Dept Head 

Faculty/Professional Staff 

Other 



1. Effectiveiy supports and inteqymts tfie mission and 
philosophy of Vincennes University. 



2. Effectively meets the otj/ectives of the position and 
'gets things done.' 



3.CrBates an environment which encourages and 
fosters the development and impiementation of 
new approaches or methods. 



4. Encourages participation of appropriate staff 
memt)efs and groups in planning, procfXiures, 
and policy intefpre^tion. 



5. Leadership pronx)tes an atmosphere conducive to 
others' personal/professional growth and learning. 



6. Deals with personnel fairly and consistentiy without 
favoritism or drscrimination. 



7. Maintains high stc-^rds of ethics, honesty, and 
integrity in alt pnsfes^vonal and university-related 
matters. 



8. Communicates perinent information in a timely 
manner. 



9. Listens well and Is receptive to individuals who 
express their ideas, opinions, and viewpoints. 



10. Prepares and administers the tMdget responsibly. 



1 1 . Successfully motivates persons to perform 
effectiveiy. 



12. Supports those responsitile to hinVher. 



13. Defends principle and conviction in the face of 
pressure and partisan influence. 



14. Is willing to make decisions which may be 
unpopular yet t)est for the overall program. 



15. Promotes an atmosphere of cooperation, mutual 
trust and high morale within his/her unit. 



16. Involves others in the decisions that affect them. 



1 7. t^emonstTBtes knowledge and competency in the 
essential aspects of the position. 



18. Maintains poise and emotional stability in the per- 
formance of his/her professional responsibilities. 



19. Is enthusiastic about his/her wori<. 



20. Effectively uses available resources. 



21 Recognizes staff achieven)ent and contnbutions. 



22 Promotes positive relationships between the 
university and community through job perfonnance 
and community involvemont. 



1994 Administrative Evaluation 



PrMM«Rt Vhw DIv. Chair D«|rt H—OI 



5 = Strongiy Agree 

4 = Agree 

3 = Undecided 

2 = Disagree 

1 ~ Strongly Disagree 

0 - 1 don't know 



OtSMT 



Code# 01 



(See reverse side) 
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1994 Administrstive Evaluation - Data Entry Coding 

CODE* 

01 President P. Summers | Directors/Dept Heads, Cont. \ \ Directors/Dept Heads, Cent. \ 



I Vice Pmsidents "I 







48 


J. Alsobrooks 


101 


P. Rath 


02 


D. Ford 


49 


K. GInes 


102 


B. Phillips 


03 


R. Stryzinski 


50 


J. Herroid 


103 


R. Kotter 


04 


J. Gegenhelmer 


51 


D. King 






05 


G. Shepherd 


52 


J. Oglesby 








53 


R. Schneider 








1 Df^ans 1 


54 


E. Wood 


Community Sen/ices: 




55 


0. Keegan 


Equal Opportunities Programs 


06 


M. Dav^s 


56 


J. Evans 






fi7 

\jt 


P Pipmnnt 


57 


J. Hanes 






08 


D Rieaie 


58 


A. Rerko 


El 


R. Patterson 


09 


V. Houchins 


59 


M. Seed 


E2 


P Chadwick 


10 


G. Smith 


60 


P. Smith 


E3 


G Harwood 


11 


M. Miller 


61 


D. Burgei 


E4 


L Luce 


19 


J Eads 


62 


J. Messmer 


E5 


D. Mann 


1 o 


J Tilley 


63 


P. Robinson 


E6 


T. Patterson 


14 


G Altstadt 


64 


B. Updegraff 


E7 


B. Stuckey 


15 


B. Bond 


65 


J.Wilson 






16 




66 


J. Beach 






17 


H. Perez 


67 


S. Brown 


1 Education and Training ProQf 


1ft 




68 


D. Eavey 






1Q 


T \A/ ^ax/fir 


69 


J. Hopkins 








70 


A. Haase 


T1 


C. Roche 




j Department Heads/Directors 


1 71 


J. Ludlow 


T2 


1 . Bodenburg 




72 


D. Marquez 


T3 


L. Brassine 


20 


C. Ezell 


73 


E. Lee 


T4 


S. Brown 


21 


J. Fabyan 


74 


D. Tyree 


T5 


S. Crooks 


22 


B Cannon 


75 


G. Whitehouse 


T6 


B. Ellis 


23 


T. McCraney 


76 


R. Weidig 


T7 


D. Gregoire 


24 


S. Penn 


77 


K. Whitkanack 


T8 


L. Griffin 


25 


V. Brenton 


78 


J. Will 


T9 


T. Judd 


26 


J Carson 


79 


J. Griffin 


T10 


D.Keith 




1 Hodndon 


80 


M. Gregory 


Til 


S. Laurent 


28 


A. Jendrzejewski 


81 


H. Jochim 


T12 


J. McKinney 


29 


J. KavanauQh 


82 


B. WIneinger 


T13 


S. Moore 


30 


D. Parman 


83 


K. Sutton 


T14 


P. Pinkstaff 


31 


C. Reinhart 


84 


B. Stephenson 


T15 


D. Robinson 


32 


R. Sommers 


85 


R. Murawski 


Tie 


S. Stewart 


33 


M. Thompson 


86 


B.Orvick 


T17 


L. Thompson 


34 


M. Trimbo 


87 


W. Abendroth 


T18 


C. Wilmes 


35 


J. Bardoie 


88 


J. Fish 


T19 


B. WootVMne 


36 


J. Ostendorf 


89 


G. Goodman 






37 


R. Shippee 


90 


H. Hensley 






38 


J. Smith 


91 


P, Jost 


1 Older Hoosier Programs 


39 


J. Stewart 


92 


S. Simonds 






40 


R. Inglis 


93 


B. Thompson 






41 


0. Miley 


94 


0. Weaver 


HI 


A. Jacoby 


42 


B. Rump 


95 


D. Winkler 


H2 


J. Coots 


43 


M. Goodrich 


96 


C. Koenig 


H3 


L. Jones 


44 


P. Bakke 


97 


W. Undsey 


H4 


P. Smith 


45 


R. Cutshali 


98 


P. Aider 


H5 


A. Stanton 


46 


D. Myers 


99 


D. Nicoson 






47 


S. Sweeney 


100 


B. Weber 
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1994 Administrative Evaluation 



These comments refer to (Name)^ 



Submitted by : An Administrator a Department Head 

_A Faculty or Professional Other 

Staff' Member 



Please duplicate an additional page for each administrator in your line for whom you wish to 
submit comments. This evaluation is voluntary and for professional development purposes. 
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To: 



Vice Presidents, Administrators, and Department Heads 



From: 



Dr. Jeanne E. Budig, Director, Research and Planning 



Date: 



May 10, 1994 



Attachment Two 



Subject: 



1994 Administrative Evaluation 



Enclosed are the results of the Vincennes University evaluation of Administrators by Faculty and 
Professional Staff. This is the eighth time that this evaluation process has been conducted and 
the results shared with you for your information. 



A task force. Chaired by Robert Slayton, worked diligently this year to simply the procedure. 
The same list of 22 questions was used for everyone, and responses for up to six persons above 
you in the chain of command could be submitted on a single page. All full-time professional 
staff and a limited number of support staff - usually senior clerical staff specifically invited by a 
Dean or a Vice President - were invited to participate in this voluntary evaluation. 

It is hoped that through a careful analysis of these results each person will develop a strategy to 
reach his or her professional potential. 

The guidelines that follow are designed to assist you in the understanding and interpretation of 
the results. Kthe guidelines are inadequate or if you have any questions about the process or 
results you should phone the President or Deans. 



The results of the evaluation are of three types: 

1. The 22-item objective portion. A cross-tabulation shows how many people answered 
each question with each possible response. A "response index" for each question provides a 
weighted value of all responses: +2 for every "strongly agree"; +1 for every "agree"; -1 for every 
"disagree", -2 for every "strongly disagree" response, divided by the total number of responses. 
"I don't know" and "I am uncertain" responses were assigned a zero value and excluded from the 
denominator. This method yields an overall "index" of response perceptions for each of the 22 
questions. 

2. The response index was converted to a bar graph showing overall positive/negative 
perceptions for each of the 22 questions. 

3. The written comments. All vmtten comments are presented verbatim, grouped by the 
level of the persons evaluating you. For example, all faculty conmients are grouped together: all 
department chairpersons conmients are together. 



Results 
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The results of the objective portion arc also grouped by level of evaluation. The person being 
evaluated (your name) and the level of the evaluators are listed at the top of each page. You 
should receive one packet for each group by whom you were evaluated. 



Ohservations: 



1 . There was a very light response rate this year, less than 33%. In many instances there 
were two, one or no responses. The decision to respond was purely voluntary. 

2 Overall evaluations were better when they referred to an zmmetizare 5wpervwor. For 
example," the response index for Vice Presidents from department heads was higher than that 
from professional or support staff (sec next page). 

3. For the most part evaluations were very good. 



Attachment Two 



By 



Norms - Academic Department Heads 



Faculty or Professional Staff 



1. £ffm:trv9ty supports Bnd irmprwis the mission mnd 
phiiosophy of Vinoennes UnDmvty. 



ZEtfectivmfyrrmmtheobjMmsofthmpostbonmnd 
*g9ts things don:' 



3. CrmtBS an environment which encoumges end 
fosters the de^etopment mnd imptementetion of 
new mpp/oeches or methods. 



4. Encoureges pettdpetion of appropnete smff 
members end groups in pfenning, procedures, 
end policy inter uretebon 



5. Leeawship promotes en etmosphere conducive to 
othen ' personei/professionel growth end teemtng. 



6. Deets with personnei feirfy end consistentiy without 
fevorrbsm or discriminetion. 



7. Meinteins high stenderds of ethics, honesty, end 
integrity in mil professionel mnd university^reieted 
metiers. 



8. Communicem pertnent infonmtion in e timeiy 
menner. 



9. Ustens weil mnd ts recepttvm to indivtdueis who 
mxpress their idees, opin^jns, end vim/pornts. 



10. Preperes mnd mdministers the budget responsibly. 



11. Successfully motymtes persons to perform 
effecHvety. 



1Z Supports those responsible to him/her. 



13. Defenxis phndpie end convtctton m the fece of 
pressure end pertisen influence. 



14. Is willing to mmke decisions which mey be 
unpopulmr yet best for the overmUprogrmm. 



15. Pnrnotesmnmtmosphereofcoopermtion, mutumi 
trust, mnd high mormie %wtfNn hisArer unit 



16. invoives others in the decisions thet effect them. 



i y. Demonstrmtes kno^^rtedge end competency in the 
essenbelespectsofthepostbon. 



18. f^mintmins poise mnd entobonml stmbility in the per- 
hrmence of his/her professronel responsibilities. 



1 9. Is enthusmstic ebout his/her work. 



20. Bffecttvety uses eveileble resources. 



21. Recognizes staff echre^mnent end contributions 



22. Promotes posrtr^ relmtionships between the 
university mnd community through job perfonnence 
end community tnvolvemenl 
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ttronQiy agra* «it«MtM ditagrM strongly don^t 
mgr— diMgrM know 



(♦2) 



78 



77 



68 



67 



71 



67 



79 



61 



76 



69 



68 



77 



70 



69 



68 



79 



77 



76 



73 



73 



69 



(0) 



40 



28 



40 



12 



10 



38 



33 



34 



33 



39 



35 



15 



10 



10 



28 



40 



34 



16 



38 



32 



13 



14 



67 30 



36 



38 



10 



11 



10 



38 



43 



13 



11 



35 



14 



40 



16 



12 



10 



16 



18 



17 



16 



11 



10 



12 



34 



13 



1 3 



{'2) iO) 



10 



12 



16 



13 



17 



14 



12 



12 



10 



10 



21 



16 



10 



14 



18 



12 



indmx ntsvnbmr of 
rempoiKferttm 

(rteteum) 



1.293 142 

1.035 142 

0.993 142 

0.942 142 

0979 142 

0.831 142 

1.203 142 

0.810 142 



1.085 
1.202 



0.786 
0.936 
1,250 
1.227 



1.123 
t064 



142 



142 



0.958 142 



1.077 142 



1.064 142 



1.037 142 



142 



142 



142 



142 



1.254 142 



142 



142 



1 171 14l 
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Attachment Three 



Norms - Vice Presidents 
1 994 Evaluation by Department Heads 



(U 

JQ 

E 

z 

c 
g 

'■4-> 

CO 
(U 

a 



Negative 



Positive 



-2 -1.5 -1 -0.5 0 0.5 1 
Response Index 



1.5 ^ * 



1. Effectivety supports and interprets the mission and 
philosophy of Vincennes University. 



2. Effectively meets the object^es of the position and 
"gets things done. " 



3. Creates an environment which encourages and 
fosters the development and implementation of 
new approaches or methods. 



4. Encourages participation of appropriate staff 
members and groups in planning, procedures. 
and policy interpretation. 



5. Leadership promotes an atmosphere conducive to 
others' personal/professional growth and learning. 



6. Deals with personnel fairly and consistently withi^ 
favoritism or discrimination. 



7. Maintains htgh standards of ethics, honesty, and 
integrity in all professional and university-related 
matters. 



8. Communicates pertinent information in a timely 
manner. 



9. Ustens well and is receptive to individuals who 
express their ideas, opinions, and viewpoints. 



10. Prepares and administers the budget responsibly 



1 1. Successfully motivates persons to perform 
effectively 



12. Supports those responsible to him/her. 



13. Defends principle and conviction in the face of 
pressure and partisan influence. 



14. Is willing to make decisions which may be 
unpopular yet best for the overall program. 



IS. Promotes an atmosphere of cooperation, mutual 
trust, and high morale within his/her unit. 



16. Involves others in the decisions that affect them. 



1 7. Demonstrates knowledge and competency in the 
3ssonf/a/ aspects of the position. 



18. Maintains poise and emotional stability in the per- 
formance of his/her professional responsibilities. 



19. Is enthusiastic about his/her work. 



20. Effectively uses available resources. 



21. Recognizes staff achievement and contributions. 



22. Promotes positive relationships between the 
university and community through job performance 
and community involvement. 
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